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Abstract 

We have shown how the intrinsic properties of a noise process can set an 

upper bound for the time derivative of entropy in a nonequihbrium system. 

The interplay of dissipation and the properties of noise processes driving the 

dynamical systems in presence and absence of external forcing, reveals some 

interesting extremal nature of the upper bound. 
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I. INTRODUCTION 



A consequence of the second law of thermodynamics is that the rate of change of entropy 
with time for a nonequihbrium stochastic process is always positive. While in traditional 
classical thermodynamics, the specific nature of a stochastic process is irrelevant, this may 
play an important role in understanding the connection between the phase space of a dynam- 
ical system and the related thermodynamically inspired quantities like entropy production, 
flux etc. The relationship has recently been explored by a number of authors P|-P^. The 
object of the present paper is to address a related issue. 

In what follows we shall be concerned with the dissipative dynamical systems which are 
thermodynamically open in the sense that they can be described by classical stochastic 
processes with the help of the standard Langevin equations. When a dynamical system is 
driven by a noise process, e. g, color [|l5l or cross-correlated processes |ll6| , p^ , the nature of 
the noise processes may influence the dynamical system through the appropriate modifica- 
tion of the phase space structure of the overall system. In view of the immediate connection 
between information entropy and probability distribution function of the phase space vari- 
ables, it is worthwhile to enquire about the imprints of the nature of noise on entropy. Our 
specific aim in this paper is to show how the properties of the noise processes can set an up- 
per bound on the rate of entropy change in a nonequlibrium system. By directly extending 
our earlier treatment on a related problem [|lT| we have examined some interesting extremal 
properties of this bound. 

The outline of the paper is as follows: In Sec. II we introduce the Fokker-Planck de- 
scription of a dynamical system driven by two different kinds of stochastic processes (e. g, 
color and cross-correlated) and an upper bound for the rate of entropy change based on this 
formulation. We illustrate the result in Section III for the two specific cases. The paper is 
concluded in Section IV. 
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II. THE FOKKER-PLANCK DESCRIPTION OF NOISE PROCESSES AND 
UPPER BOUND FOR THE RATE OF ENTROPY CHANGE 



We consider a dynamical system driven by the external Ornstein-Uhlenbeck noise pro- 
cesses. The relevant Langevin equations of motion can be written as 

x, = F^{{x,})+v^, t = l,---,N (1) 

where N is the dimension of the phase space. F^{x) corresponds to the dissipative term as 
well as the external applied deterministic force, if any. The second term rji in Eq.(l) refers 
to an external, Gaussian, color noise for the i-th component of x. 

The Fokker-Planck equation corresponding to Langevin Eq.(l) in the extended phase 
space can be written as [for details, see Ref. |1T 



where 

{= Xi for i = 1, ■ ■ ■ , 
= rii fori = A^ + l,---,2iV 

Fi and Di are drift and diffusion coefficients, respectively, and have their usual significance as 
discussed in Ref. [[l^]. p{X,t) is the extended phase space probability distribution function. 

As a second example we consider a dynamical system driven by both additive and mul- 
tiplicative noise processes rji and Q, respectively. The Langevin equation for this process, in 
general, can be written as 

Xi = Li{{Xi},t)+giiXi)Ci + v^ i = l,---,N (3) 

Li contains the dissipative term as well as the external applied deterministic force, if any. 
gi{Xi) is the coupling between the system and the multiplicative processes Q. Q and rji are 
white, Gaussian noise processes with the following correlation between them; 



imVjit')) = Ut')r^M = 2\,^a^,5{t - (4) 



D'^j and aij correspond to the strength of multiphcative and additive noises, respectively 
and A represents the cross correlation between them with the limit < A < 1. 

The Fokker-Planck equation corresponding to Langevin Eq.(3) can be written as 

Again Fi and Di are drift and diffusion coefficient, respectively, and have same signifi- 
cance as in the Eqs. (11-13) of Ref. [jTIl . 

The Fokker-Planck Eqs. (2) or (5) can be rearranged into the general form of continuity 
equation 

^ ^ -v.. (6) 

where j denotes the current and Vx term the phase space divergence. The i-th compo- 
nent of j can be written as 

Using Eq. (6) we are now in a position to define the upper bound for the rate of evolution 
of entropy. In the microscopic picture, the Shannon form of the entropy is connected to the 
probability density function p{X, t) as 



S = - J dXp{X,t)\np{X,t) . (8) 
The time evolution equation for entropy can then be written as 

J dXVx-jlnp , (9) 



dS_ 
It 



where Eq.(6) is used. 

Integrating Eq.(9) by parts, one obtains 



f = -/«i,VvP. (10) 



where we have used following boundary conditions 



j I boundary ( ) 

and 

j In plboundary = (12) 

In the next step an application of the Schwartz inequahty | / dXgh^^ < J / dXlhl"^ 

to the integral (10) where g and h can be appropriately identified yields an upper bound for 
the rate of entropy change 

It is important to note that the second integral is same as the trace of Fisher information 
matrix p[ and this inequality is valid if and only if jj ^ is not a constant multiple of 
iy xP) I \fp- To find the explicit time dependence of the upper bound we work out simple 
examples for each of the noise processes in the next section. 



III. APPLICATIONS 



A. The upper bound for a dynamical system driven by an external color noise 

As a simple illustration, we consider a Langevin equation of motion for a dissipative 
dynamical system driven by an external, Gaussian Ornstein-Uhlenbeck noise, rix. 

Xi = -7Xi + /, + r/i (14) 

The noise correlation of ri\ is given by 

/)0 / \t-t'\\ 
(^i(tH(0) = — exp(^-^^j (15) 

7 in Eq.(14) is the dissipative parameter and /c is a constant external applied force term 
which is used to identify specific interplay between 7 and r. 

5 



For the Langevin Eq. (14) the Fokker-Planck Eq.(2) becomes (see Ref.[ll]) 

dp^ axip_^_^ D^av .... 

dt ^ dX, ^'dX, ^dX, T 8X2 t2 dxi ^ ^ 

where X2 — rji. 

We now use the following transformation in the Eq.(16) 

U^aXi + X2 , (17) 

where a is a constant to be determined. 

Then Eq.(16) reduces into the following one dimensional form: 

—dT- - du^^^^P ~ ^-du + ^'mp ' ^^^^ 

where 

X 

TU = 'yaXi - 0X3 + — , F„ = af^ and D, = — . (19) 

Here T is again a constant to be determined. Using Eq.(17) in Eq. (19) and comparing 
the coefficients of Xi and X2 we find 

r = 7 and a = ]lZJL . (20) 

T 

We then search for the Green's function or conditional probability solution for the system 
at U at time t for the initial condition given by 

p(U, i = 0) = lim - exp[-e(C/ - U')^] (21) 

e->cx3 Tj- 

We now look for a solution of the Eq.(18) of the form 

p{U,t\U',0)^eMG{t)] (22) 

where 

G(i) = -^([/-/3(i))^ + ln^(i) (23) 



We will see that by suitable choice of P{t), (T{t), v{t) we can solve Eq.(18) subject to the 
initial condition 



p{U, 0|C/', 0) = lim - exp[-e(C/ - U'f\ . (24) 



TT 

Comparison of this with (22) and G(0) shows that 

a(0) = m = [/', ^(0) = - . (25) 
e TT 

If we put (22) in (18) and equate the coefficients of equal powers of U we obtain after 
some algebra the following set of equations 

a{t) = -2Ta{t) + 4D, (26) 
P{t)^-P{t)+F^ (27) 

The relevant solutions of a{t) and P{t) for the present problem which satisfy the initial 
conditions as stated earlier are given by 

2D 

a{t) = - exp(-2n)) + (t(0) exp(-2n) (29) 

and 

m = ^(1 - exp(-2n)) + m exp(-n) (30) 

Now making use of Eqs. (22), (29) and (30) in (13) we finally obtain explicit time 
dependence of the upper bound U b it) for the rate of entropy change as 

dS , , 

Tt ^ 



where 



^^^^^ ^ (2/3^rV - A^VF^a + 2F> + rV^ + 4£>g - W.Vaf"^ ^^^^ 



We now examine specifically the long time limit, i. e, f — > oo of the above result (31). 

As t — > oo Eqs. (29) and (30) reduce to 

2D F 
a(oo) = ^ and /3(oo) = ^ . (32) 

It is easy to check that as i — > oo the numerator of the right hand side of Eq.(31) vanishes 
both in presence or absence of F„. Therefore we obtain the equation 

This equahty holds since in the long time limit j — Q (see Eq. 18). At any other time 
the time dependence of the upper bound Ub for the rate of entropy change is explicitly 
shown in Fig.l. We choose the initial conditions (t(0) = 0,/5(0) = 1.0 and parameter values 
D° = 1.0, /c = 1.0, 7 = 1.0 and r = 1.0. Fig.l shows that except for an initial short period 
C/s(t) decreases almost exponentially with time. In absence of /c the time dependence of Ub 
follows a similar pattern. In Fig.2(a-b) we plot t/^ at t = 5 vs correlation time r in absence 
and presence of the external forcing f^. As expected Ub increases monotonically with the 
T [in Fig.2(a)] which is a clear signature of the persistence of the nonequilibrium situation 
in contrast to the case in Fig. 2(b) where the interplay of r with external forcing results 
in a minimum in Ub- The result of Fig.2(b) is qualitatively same to that of the Fig.l of 
Ref.[ll] where only entropy production in the stationary state is considered. In the present 
context however the upper bound of the sum of entropy production and entropy flux [11] 
at any arbitrary time is considered. The relation between entropy flux {Ep) and entropy 
production {Ep) in the long time limit for the present model [11] is 

Ep^-Ep ^ ^ 2o ■ (34) 

Using above equation in Eq.(31) at time i — > oo we have 

Ub = [2'iEp + 2'-iEpY''^ = 0. (35) 

Since near equilibrium Ep approaches —Ep the upper bound of time derivative of entropy 
as shown in Fig. 2(b) mimics the result of Fig.l of Ref.[ll]. 
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In Fig. 3(a-b) we plot the variation of Ub (at t = 5.0) vs dissipative constant 7 in 
absence (3a) and presence (3b) of the external force fc- While an increase in 7 facilitates 
the approach to stationarity as evident from the monotonic decrease of the bound in Fig. 
3(a), its effect becomes more interesting when the external fc is switched on (Fig. 3(b)). 
One observes that the bound passes first through minimum followed by a maximum to settle 
down at the vanishing level for the large values of dissipation. It is thus apparent that in 
presence of the external constraint the properties of the noise processes and the dynamical 
characteristics of the system play an important part for the upper bound for the rate of 
entropy change. 



B. The upper bound in a cross-correlated noise driven system 

We now turn to the second case where a simple dissipative system is driven by both 
additive and multiplicative noises. 

Xi = -7X1 - CiXi + vi (36) 

Eq.(5) for this system reduces to ( for details, see Ref. |n|] ) 

-^^--^xT^ 'dx! ^^^^ 

where the drift term is 

Fi = -{-f + 2D[^-u)Xi + l (38) 

with 



l = {2-u)Xu^D[,an , (39) 

and 

n bii7^ + (2 - u)D[,au{{2 - u)D[, + 27 - 2^\i, - \l,{2 - u)D[,}] 

^1 - l4Uj 

where 
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r' ^^ + 2D[^-u . (41) 

Here D[i and an are the multiplicative and additive noise strength respectively. An is the 
cross-correlation between the noise processes, u — 1 stands for the Startonovich and u — 
for the Ito convention, respectively. 

The Eq.(37) is very much similar to Eq. (18). Hence, the upper bound for the rate of 
entropy change can be calculated as in the previous case and the final expression for the 
upper bound Ub is given by 

dS , . 

Tt ^ 

where 

UB[t) = . [4:Z) 

Here the time evolution of cri(t) and /9i(t) can be written as 

on 

a^{t) = ^(1 - exp(-2n)) + ai(0) exp(-2r'i) (43) 

and 

H^) = f7(l - exp(-2r'i)) + /3i(0) exp(-r'i) (44) 

The initial conditions for cri(O) and /3i(0) can be chosen as in Eq.(25). l^D\ and V are 
determined by Eqs. (39), (40) and (41). Again it is easy to check that for the correlated 
noise process under stationary condition we obtain the usual equality 

The time dependence of Ub for a correlated noise process (we fix the parameter values 
as 7 = 1.0, Du — 1-0, All = 0.5, ctn = 1.0 and the initial conditions (7i(0) = 0, /?i(0) — 0) is 
more or less same as that of Fig.l. In Fig.4 we exhibit the variation of C/s {at t — 5.0) with 
the strength of correlation An. It is interesting to note that although both multiplicative 
and additive noises are independently and instantaneously correlated their mutual strength 

10 



of correlation An drives the system away from stationarity more strongly (as compared to 
the case corresponding to the variation of correlation time r in Fig. 2(b)). No minimum, 
however, is obtained. We mention, in passing, that since the models considered here are 
linear and are exactly solvable by Green's function of Gaussian form the computed upper 
bound is an exact one. 

IV. CONCLUSIONS 

Based on Fokker-Planck description of color and cross-correlated noise-driven dynamical 
systems we have shown how the intrinsic properties of a noise process can set an upper 
bound for the rate of entropy change in a nonequilibrium system. Since the dissipative 
forces tend to equilibrate the system while an increase in the noise correlation time in a 
color noise process or an increase in the strength of correlation in cross-correlated noise 
processes acts in the opposite direction, an interplay of them makes the dynamical system 
exhibit interesting extremum properties of this upper bound. This is manifested in the 
maxima and minima of the bound for the time derivative of Shanon entropy as a function of 
the strength of dissipation, correlation time or strength of correlation in presence or absence 
of the external forces acting on the dynamics. Since the color and cross-correlated noise 
processes occur in many situations in physics and chemistry, the observation made in this 
paper, we hope, will be useful for understanding the close connection between irreversible 
thermodynamics and dynamical systems in many related issues. 
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Figure captions 



Fig.l. Plot of upper bound for the time derivative of entropy ]iiUB{t) vs time t for the 
Eq.(31) using 7 = 1.0, /c = 1.0, D° = 1, t ^ 1.0, f3{0) = 1.0 and a{0) = 0.0 (Units are 
arbitrary) . 

Fig.2(a). Plot of C/s vs correlation time t a,t t — 5.0 for the Eq.(31) using fc — 0.0 and 
values of other parameters same as in Fig.l (Units are arbitrary). 
Fig.2(b). Same as in Fig. 2 (a) but for /c = 1.0 (Units are arbitrary). 

Fig. 3(a). Plot of C/b vs dissipative constant 7 at i = 5.0 for the Eq.(31) using r = 1.0 and 
values of other parameters same as in Fig. 2 (a) (Units are arbitrary). 
Fig. 3(b). Same as in Fig. 3(a) but for fc = 1.0 (Units are arbitrary). 

Fig.4. Plot of C/fi vs noise correlation strength An a,t t — 5.0 for the Eq.(42) using 7 = 1.0, 
Dn = 1, an = 1-0, /3i{0) = 1.0 and (Ti(0) = 0.0 (Units are arbitrary). 
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